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A new primal-dual algorithm is presented for solving a class of non-convex minimization prob- 
lems. This algorithm is based on canonical duality theory such that the original non-convex 
minimization problem is first reformulated as a convex-concave saddle point optimization prob- 



| lem, which is then solved by a quadratically perturbed primal-dual method. Numerical examples 

are illustrated. Comparing with the existing results, the proposed algorithm can achieve better 
performance. 
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csj ; 1 Problems and motivations 

The nonconvex minimization problem to be studied is proposed as the following: 



(P„): uuu{P(x)=W(x) + ~(x,Ax)-(x,f)\xeX a \ . (I) 



where x = {xi} £ 1" is a decision vector, A = {Ay} e M ,IX " is a given real symmetrical matrix, 
/ = {fi} e i s a gi ven vector, (*, *) denotes a bilinear form in R n x K n ; the feasible space X a 
is either M™ or a subset of W 1 with linear constraints, such that on which, the nonconvex function 
W : X a -> R is well-defined. 

Due to the nonconvexity, Problem (V ) may admit many local minima and local maxima [1]. It is 
not an easy task to identify or numerically compute its global minimizer. Therefore, many numerical 
methods have been developed in literature, including the extended Gauss- Newton method (see |17jV 
the proximal method (see |18j). as well as the popular semi-definite programming (SDP) relaxation 
(see [33]). Generally speaking, Gauss- Newton type methods are local-based such that only local 
optimal solutions can be expected. To find global optimal solution often relies on the branch-and- 
bound [2] as well as the moment matrix based SDP relaxation [T^] - However, these methods are 
computationally expensive which can be used for solving mainly small or medium size problems. 

Canonical duality theory has been used successfully for solving a large class of global optimization 
problems in both continuous and discrete systems [U |B]. The main feature of this theory is that, 



1 



depends on the objective function W(x), the nonconvex/nonsmooth/discrete primal problems can 
be transformed into a unified concave maximization problem over a convex continuous space, which 
can be solved easily by using well-developed convex optimization techniques. This potentially useful 
theory was developed from Gao and Strang's original work [9] where the nonconvex function W(x) 
is the so-called stored energy, which is required, by the concept (see 20 , page 8), to be an objective 
function. In physics, a real-valued function is said to be objective if only certain fundamental rules 
are satisfied (see PQ or Chapter 6 in [3]). For example, if W(x) is objective, it should be an invariant 
under certain coordinate transformations. Therefore, instead of the decision variables directly, an 
objective function usually depends on certain measure (norm) of a;. In this paper, we shall need only 
the following weak assumptions for the nonconvex function W(x) in (V ). 

Assumption 1 

(Al). There exits a geometrical operator A(x) : X a — > V a C M m and a strictly convex 
function V : V a C W n -> K such that 

W[x) = V{A{x)) Mx G X a . (2) 
(A2). The geometrical operator A(x) is a vector- valued quadratic mapping in the form of 
A(ac) = j~(sc, Axsc) - {x,bi), • • • , ~(x,A m x) - (cc,b m ) j , (3) 

where Aj, i = 1, • • • , m, are matrices with appropriate dimensions, and b i; i = 1, • • • , m, 
are given vectors. 

Actually, Assumption (Al) is the so-called canonical transformation. Based on this assumption, 
the proposed nonconvex problem {V ) can be reformulated in the following canonical form: 

(P): min(p(x) = V(A(x)) + ^(x,Ax)-(x,f) : xe X a j. (4) 

The canonical primal problem (V) arises naturally from a wide range of applications in engineering 
and sciences. For instance, the canonical function V(£) is simply a quadratic function of £ = A(x) in 
the least squares methods for solving systems of quadratic equations A(x) = d G W" 1 (see [H]), chaotic 
dynamical systems [3T] , wireless sensor network localization [8] , general Euclidean distance geometry 
[15] . and computational biology |37j . In computational physics and networks optimization, the position 
variable x is usually a matrix (second-order tensor) and the geometrical operator £ = A(x) is a positive 
semi-definite (discredited Cauchy-Riemannian measure) tensor (see [5]), the convex function V(£) is 
then an objective function, which is the instance studied by Gao and Strang [HIS]- Particularly, if 
W(x) is a quadratic function, the canonical dual problem is equivalent to a SDP problem (see [8]). By 
the facts that the geometrical operator defined in the Assumption (A2) is a general quadratic mapping, 
the nonconvex function W(x) studied in this paper is not necessary to be "objective" , which certainly 
has extensive applications in complex systems. 

The rest of this paper is divided into six sections. The canonical dual problem is formulated in 
the next section, where, some existing difficulties are addressed. The associated canonical min-max 
duality theory is discussed in Section 3. A proximal point method is proposed in Section 4 to solve 
this canonical min-max problem. Section 5 presents some numerical experiments. Applications to 
sensor network optimization are illustrated in Section 6. The paper is ended by some some concluding 
remarks. 
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2 Canonical duality theory 

By Assumption (Al), the canonical function V(-) is strictly convex and differentiable on V a , therefore, 
the canonical dual mapping ? = W(£) : V a X V * C K m is reversible such that the following canonical 
duality relations hold on V a xV*. 

? = W(€) « = v* (?) o + = (£, (5) 

where V*(?) is the Legendre conjugate of V(£)- Clearly, we have the inverse Legendre conjugate 

V(A(x)) = mzx{(A(x),<;) - V*(s) |?G K}. (6) 
By substituting © into (0]), Problem (P) can be equivalently written as 

minmax{S(a;, | (x,?) G Af a x V*}, (7) 
where 3 : X a x V* —¥ M. is the iota/ complementary function defined by 

S(x,?) = (A(x),<;)-V*(<;) + ~(x,Ax)-(x,f) 

= i^GW^-risj-^TW). (8) 



in which 



and 



GW=A + ^ ft A t , (9) 



fe=i 



= (io) 

fe=i 

For a given ? £ V*, the criticality condition Vx^x, ?) = leads to the following canonical equilibrium 
equation 

G(t)x = r(?). (11) 

Let 

«S a = {? G V* | 3 cc g A" a , such that G(?)sc = r(?)} 
be the dual feasible space, on which, the canonical dual function is defined by 

P%) = st & {E(x, ?) | x G X a ) = -i(Gt(0r(?),r(0> - (12) 

where sta { } stands for finding value of the expression in { } at its stationary points, and G^ represents 
the generalized inverse of G. Particularly, let 

5+ = {<r e V Q * | G(s) h 0} , (13) 

where G(?) >; means that the matrix G(?) is positive semi-definite. Clearly, the total-complementary 
function S(x, ?) is convex- concave on >Y a x <S+, by which, the canonical dual problem can be proposed 
as the following: 

(V d ): max{P d (<;)| (14) 
The following result is due to the canonical duality theory. 
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Theorem 1 (Gao |6j) Problem (P d ) is canonically dual to (V) in the sense that if <; is a critical 
solution to (V ), then the vector 

S = Gt(?) T (?) (15) 

is a critical point to (V) and P(x) — P d (<i). 

Moreover, if ^ £ Sj, then x is a global minimizer of (V) if and only if c; is a global maximizer of 
(V d ), i.e. 

P(x)=minP(x) ^ max P d (<;) = P d (s). (16) 

This theorem shows that if the canonical dual problem (V d ) has a critical solution on <S+, then the 
nonconvex primal problem (V) is equivalent to a concave maximization dual problem (V d ) without 
duality gap. If we further assume that X a = 1" and the optimal solution <; to Problem (V d ) is an 
interior point of <S+, i.e., G(s) >~ , then the optimal solution x of Problem (V) can be obtained 
uniquely by x — G -1 (s)t(s) (see [31]). 

However, our experiences show that for a class of "difficult" global optimization problems, the 
canonical dual problem has no critical solution in such that G(s) y 0. In this paper, we propose 
a computational scheme to solve the case in which the solution is located on the boundary of <S+, i.e. 
the dual solution ^ satisfying G(?) G dS^ ■ To continue, we need an additional mild assumption: 

A3 There exists an optimal solution x of Problem (V) such that G(s) >r 0, where ^ = W(£)\£ = \(&)- 

In fact, Assumption (A3) is easily satisfied by many real-world problems. To see this, let us first 
examine the following examples. 

Example 1 Suppose that X a is a bounded convex polytope subset of 1". Since X a contains only 
linear constraints, both V a and S a are also close and bounded. Let x be the smallest eigenvalue of 
J2T=i SkA-k, where <; — [<ri,-- - ,S m } T £ S a - Since S a is bounded, x > ~oo. Let x be the smallest 
eigenvalue of A. If \ + X > 0, then Assumption (A3) is satisfiecjl]. 

This example shows that if the quadratic function i (a;, Ax) is sufficiently convex, the non-convexity 
of V(A(x)) becomes insignificant. Thus, the combination of them is still convex. However, this is 
a special case in nonconvex systems. The following example has a wide applications in network 
optimization. 

Example 2 Euclidean distance optimization problem: 



mm 



(\\xi - xjf - d?,.) + ^ (|K - a k \\ 2 - dlY | x t G M d V< = 1, . . . ,n }, (17) 

k 



where Xi is the location vector in Euclidean space K d , dij and dk are given distance values, the 
vectors {a^} are pre-fixed locations. Problem (fT7|) has many applications, such as wireless sensor 
network localization and molecular design, etc. For this nonconvex problem, we can choose A(x) 
to be the collection of all Aij(x) — \\xi — Xj\\ 2 and Ak(x) = \\xk — at\\ 2 ■ In this case, V(£) = 
Y^ij(£ij ~ dij) 2 + - d 2 k ) 2 . If (iTTl) has the optimal function value of 0, then ^ = d 2 ^ and 

£fc = d 2 , where ^ = A(x) and x is an optimal solution of problem (fl7|) . It is easy to check that the 
dual variable <j = 0. Thus, detG(^) = 0. Therefore, Assumption (A3) holds. 



1 In fact, Problem (V) is convex under the condition x+X 0- The proof of this result is similar to that of Proposition 
1 given in |10| . 
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This example shows that Assumption (A3) is satisfied in the least squares method for solving a 
large class of nonlinear systems [211 [22] • It is known that for the conventional SDP relaxation methods, 
the solution of problem ([TT)) can be exactly recovered if and only if the SDP solution of Problem ([T7)l 
is a relative interior and the optimal function value of problem (IT7|) is [TT] . If the problem (fTT)) has 
more than one solution, the conventional SDP relaxation does not produce any solution. The goal of 
this paper is to overcome this difficulty by proposing a canonical primal-dual iterative scheme. 

3 Saddle-point problem 

Based on Assumption (A1-A3), the primal problem (P) is relaxed to the following canonical saddle 
point problem: 

(SP) : minmax(s(a;,<0 = hx, G(s)a;) - V*(?) - (x,t(s)) | (x,c) G X a x 5+1 . (18) 

Suppose that is a saddle point of Problem (SP). If det(G(<r)) ^ 0, we call Problem (SP) is 

non-degenerate. Otherwise, we call it degenerate. 

3.1 Problem (SV) is non-degenerate 

Theorem 2 Suppose that Problem (SP) is non- degenerate. Then, x is a unique solution of Problem 
(P ) if and only if (x,s) is a solution of Problem (SP). 

Proof. Suppose that (x, is the solution of Problem (SP). Since Problem (SP) is non-degenerate, 
G(s) >- 0, i.e., ^ e int t S + . Thus, V c H(a:,s) — ^ — A(x) = 0. For any x e X a , we have 

min P(x) = min ruaxSfcc.O = min maxSfa;,^) = H(x, c) = P(ic). 

Thus, a; is the optimal solution of Problem (P). 

On the other hand, we suppose that x is the optimal solution of Problem (P). Let <; = VV(A(i)). 
Then, 

P(x) — S(sc, = max S(S, <j). 

Since V(-) is strictly convex, we have 

E(x, ?) < E(x, 5) V ? 6 V a * c R m . (19) 

The equality holds in (|19[) if and only if <; = i; since B(ic, s) is strictly concave in terms of Suppose 
that (a;i,si) is also a saddle point of Problem (SP). By a similar induction as above, we can show 
that x\ is an optimal solution of Problem (P). Furthermore, P(xx) — E(xx,<ix)- S ince X\ £E A* a , we 
have 

P(aji) = E( Xl ,<ix) < E(x,sx) < S(x,s) = P(cc). 

The first equality holds only when Xx — x since G(?i) y 0. The second inequality becomes equality 
if and only if si = c since V(-) is strictly convex. By the fact that x is an optimal solution of Problem 
(P) and Xx S A^, P(a;i) = P(x), X\ — x and <Ti = <r. Thus, (x,s) is the solution of Problem (SP). 
We complete the proof. ■ 

If X a = M. n , the saddle point Problem (SP) can be further recast as a convex semi-definite 
programming problem. 
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Proposition 1 Suppose that Problem (SV) is non- degenerate and X a = W 1 . Let <; be the solution of 
the following convex SDP problem: 



(SDP): min{V*(<j)+ff} s.t. 



G(0 r(«) 
T T (S) 2g 



h 0. (20) 



Then, the SDP problem defined by I120\) has a unique solution (g,<i) such that G(s) >- 0. Furthermore, 
x = G _1 (s)t(s) is the unique solution of Problem (V). 

Proof. By Schur complement lemma [35], the SDP problem ([20]) has a unique solution (g, <r) such that 
G(s) >- if and only if the following convex minimization problem 

min j^*(<0 + l(G- 1 WrW ) rW)| G(?) h oj (21) 

has a unique solution <; such that G(?) >- 0. Since X a = R™, the convex minimization problem (|2"Tj) is 
equivalent to Problem (ST 7 ) by Theorem 3.1 in [34]. ■ 

Remark 1 Theorem&is actually a special case of the general result obtained by Gao and Strang in fi- 
nite deformation theory f^. Indeed, if we let W(x) — W (x) + ^ (x , Ax) andA(x) = {A(x), ^{x, Ax)}, 
then, the so-called complementary gap function is simply defined as 

G(x,<;) = ±(x,G(<;)x). 

Clearly, this gap function is strictly positive for any non zero x £ X a if and only if G(c;) >- 0. Then 
by Theorem 2 in f3/ we know that the primal problem has a unique solution if the problem (SV ) 
is non-degenerate. By Theorem^ and Proposition \1\ we know that the nonconv ex problem (V) can 
be solved easily either by solving a sequence of strict convex- concave saddle point problems, or via 
solving a convex semi-definite programming problem if Problem (SV) is non- degenerate. By the fact 
that g = i(G _1 (^)T(?), t(s)) is actually the pure complementary gap function (see Eqn (19) in J2J?), 
the convex SDP problem t20\) is indeed a special case of the canonical dual problem (V ) defined by 
Moreover, the canonical duality theory can also be used to find the biggest local extrema of the 
nonconv ex problem (V) (see \3^j ). 

3.2 Problem (SV) is degenerate 

If Problem (SV) is degenerate, i.e. G(s) >r and det(G(s)) = or ^ G dS+, it has multiple saddle 
points. The following theorem reveals the relations between Problem (V) and Problem (SV). 

Theorem 3 Suppose that Problem (SV) is degenerate. 

1) If x is a solution of Problem (V) and <; = W(A(x)), then (x,s) is a saddle point of Problem 

(SV). 

2) If (x,s) is a saddle point of Problem (SV), then x is a solution of Problem (V). 

3) If (xi,$i) and (x2,$2) a-re two saddle points of Problem (SV), then <Jx = <?2- 

Proof. 1). Since x is a solution of Problem (V) and = W(A(x)) £ <S+ (by Assumption (A3)), 

S(5,0<S(Se,5), V?eS+ 



(i 



Furthermore, 

(VP(x),x- x) > 0, Vx G X a . 
Substituting VP(x) — G(s)x — t(?) = V x E(x,<;) into (f2"2"j). we obtain 

(V x Z(x,s),x - x) >0, \fxeX a . 

Thus, 



(22) 



min S(x,<;) = E(sc,c) 



Therefore, 



S(x, ?) < £(x, §) < S(x, §), V (x, ?) g Xa x S+. 



This implies that (x, s) is a saddle point of Problem (ST). 

2). Suppose that (x,s) is a saddle point of Problem (SP) and V c E(x,s) = 0. Then, 



P(x) = H(x, 5) < S(x, §), V (x, t)e^x 5+ 



On the other hand, 



S(x,^) = A(x)) - V*(js) - U{x) < V{A(x)) - U(x) = P(x). 

Combining the above two inequalities, a; is a solution Problem (P). 

3). This result follows directly from the strict convexity of both V(-) and V*(-). The proof is 
completed. ■ 

Theorem [3] shows that the nonconvex minimization Problem (P) is equivalent to the canonical 
saddle min-max Problem (SP). What we should emphasize is that the solutions set of Problem (P) 
is in general nonconvex, while the set of saddle points of Problem (SP) is convex. For example, let 
us consider the following optimization problem: 



f 1 2 1 

min i - ((asi + x 2 f - l) + - ((n - z 2 ) 2 - l)' 

Let £ = A(x) = [(xi + x 2 f - 1, (an - x 2 ) 2 - 1] T Then, 



(a;i,x 2 ) G 



(23) 



G(c) 



ft + ft ft - ft 
ft — ft ft + ft 



V*(«) = §<; T <j. Thus, G(<r) h ft > and q 2 > 0. Clearly, (x,s) is a saddle point of Problem 
(SP) if and only if (x, s) is the solution of the following variational inequality: 



G(s)x = 0, 

(W(?)-A(sc),?-?) > 0, V? > 0. 



(24) 
(25) 



It is easy to verify that the optimization problem (|23|) has four solutions (1,0), (0,1), (—1,0) and 
(0, —1). Clearly, its solution set is non-convex. On the other hand, by the statement 3) in Theorem 
3, we have <; = 0. Thus, (x, <;) is a saddle point of Problem (SP) if and only if <j = and x satisfies 

(x l +x 2 f < 1, 
(x 1 -x 2 f < 1. 
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Denote = convhull{(l, 0), (0, 1), (—1, 0), (0, —1)}, where convhull means convex hull. Therefore, the 
saddle point set of Problem (SP) is ft x which is a convex set. This example also shows that the 
solutions of Problem (P) are the vertex points of the saddle points set of Problem (SP). 

Now we turn our attention to the saddle point problem (SV). For some simple optimization 
problems, we can simply use linear perturbation method to solve it. To illustrate it, let us consider a 
simple optimization problem given as below: 

(Pi): mmP 1 (x) = ^(^x T A 1 x-b 1 ^ + X - Qx T A 2 x - b 2 ^j -(*,/). (26) 

Proposition 2 Suppose that there exists (ft, ft) such that ftAi + ftA 2 >~ 0. If the saddle point (x,s) 
of the associated Problem (SPi) is on the boundary of , then for any given e > 0, there exists a 
Af £ R n such that ||A/|| < e and the perturbed saddle point Problem (SVi) 

(SVi): nhnnmx(i(x,G(<0x)-V<r + A/) : (x,?)eR"x5+ 

has a unique saddle point (x p ,^ p ) such that G(^ p ) >- 0. Furthermore, x p is the unique solution of 

{VI th ): mmP 1 (x) = ±(±x T A 1 x-b^ + ± Qx T A 2 x - 6 2 ) -(x,f + Af). 
where G(s) = ftAi + ftA 2 . 

Proof. Since x £ IR™, Problem (SPi) is equivalent to the following optimization problem: 

max - -(/ + Aff^G- 1 (<;)(f + Af) 

s 2 

s.t. G(<r) t 0. (27) 

By the assumption that there exists (ft, ft) such that ftAi + ftA 2 >- 0, Ai and A 2 are simultaneously 
diagonalizable via congruence. More specifically, there exists an invertible matrix C such that 

C T AiC = diag(<4,--- ,<0, 
C T A 2 C = diag(a?,.-. ,<£). 

Under this condition, it is easy to show that for any given e > 0, there exists a Af £ 1" such that 
\\Af\\ < e and 

lim \(f + A/fWG-^X/ + A /) = +<*>• 

Thus, the solution of the optimization problem (|27J1 cannot be located in the boundary of 5+ for this 
Af. The results follow readily. We complete the proof. ■ 

From the Proposition Q] we know that if the solution x of Problem (Pi) satisfies G(?) >- 0, 
then it can be obtained by simply solving the concave maximization dual problem (P d ). Otherwise, 
Proposition [2] shows that this solution can be obtained under a small perturbation. Thus, the non- 
convex optimization problem (Pi) can be completely solved by either the convex SDP or the canonical 
duality. However, for general optimization problems, the linear perturbation method may not produce 
an interior saddle point of Problem (SP). To overcome this difficulty, we shall introduce a nonlinear 
perturbation method in the next section. 
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4 Quadratic Perturbation Method 

We now focus on the solution of Problem (SV) when it is degenerate. Clearly, Problem (SV) is 
strictly concave with respect to However, if Problem (SV) is degenerate, i.e., <; € 9S^, then 
Problem (SV) is convex but not strictly in terms of x . In this case, Problem (SV) have multiple 
solutions. To stabilize such kind of optimization problems, nonlinear perturbation methods can be 
used (see [7])- Thus, by using the quadratic perturbation method to Problem (SV), a regularized 
saddle point problem can be proposed as 

min max S Pfc (#,<;) = 3(x,0 + -£-\\x — x k \\ 2 , (28) 
x ses+ 2 

where both x k and p k , k = 1,2, • • • , are given. In practical computation, the canonical dual feasible 
space <S+ can also be relaxed as 

S+ k =UeV* a cW n : G(t) + A*fc/>=0}, 

where p, k < p k - Note that 

s p*(*>«) = -(jc,(G(s) +p k I)x) - V*(s) - (x,p k Xk + T(<;)) + ?±(x k ,x k ). 
Thus, E Pk (x, s) is strictly convex-concave in K™ x <S+ fc and 

min max S Pfc (a:,<;) = max min S Pfc (x, 

For each given <; 6 5+ , denote 

scfc) = argminS Pfc (a;,^). 

a; 

Then, x(s) — (G(<;) + p k I)~ 1 (p k x k + t (<;)). Substituting this x(<;) into H pi .(x,s), we obtain the 
perturbed canonical dual function 

Now our canonical primal-dual algorithm can be proposed as follows. 
Algorithm 1 

Step 1 Initialization xq, po, N and the error tolerance e. Set k — 0. 

Step 2 Set <; k +i = argmax ( _ g<s + Pp k (s) and x k+1 = (G(<; k+1 ) + p k iy x (p k x k +r(<; k+1 )). 
Step 3 If ||sfc+i — ^fc|| < e, stop. Otherwise, set k = k + 1 and go to Step 2. 
Theorem 4 Suppose that 

1) P > Pfc > 0, o-fc = Y,i=i Pi -> Pk I 0, /i fc J, and < ^ fc < Pfc/ 

2) for any gwen x, lim||< rfc ||_ > . 00 E(x,<f/-) = -co; 

3) The sequence {x k } is a bounded; 

Then, there exists a (x,$) £ K n x 5+ sucft £/ia£ {x kl <; k } —> (x,s). Furthermore, (x,$) is a saddle 
point of Problem (SV). 
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Proof. Note that < p k < p k , the perturbed total complementary function S Pfc (x,<;) is strictly 
convex- concave with respect to (x,<;) in 1" x 5+. Since (x k ,s k ) is generated by Algorithm [TJ we 
have 

(xk,<ik) = argmin max E p k (x,s) = argmin max S(x,<?) + -^||x - x k -i\\ 2 . (29) 

That is 

Z Pk (x k ,<;) < Z Pk (x k ,<; k ) < E Pk (x,<; k ), V(x,s) e R" x <S+ . 

By the fact that p k I and 5+ = {<; G V a * : G(s)+fi k I h 0}, we have 5+ D 5+ +1 and f| fc <S+ = S+ . 
To continue, we suppose that (x, is a saddle point of Problem (SV), i.e., 

a(x,«) <a(x,«) <a(x,«), v(x,o 6i"x5+ 

Now we adopt the following steps to prove our results. 

1) The sequence {x k } is convergent, i.e., there exists a x such that x k — > x. 
From (f2"9")h we have 

Sp^^Xfe,^) = S(aj fe ,<; fc ) + ^Y~\\x k - x fc _i|| 2 < Z Pk _ 1 (x k -i,<; k ) = H(x fc _i,s fc ). (30) 
Clearly, 

S(x fc _i,^fc) + -^-\\x k -i - cc fc _ 2 |t 2 = S pk _ 2 (x k -x,<;k)- (31) 

Since Sfc £ <S+ fc C <5j fc _ 1 and (xfe_i,<jfe_i) is the saddle point of S P(c l (x, <j) in K ra x <S£ , we 
obtain 

a pfc _ 2 (x fc _i,<f fe ) < S Pfc _ 2 (x fc _i,^ fc _i) = "(xft-i.^-i) + ^y^Hajfc^i — 03^—2 1| 2 - (32) 
Combining (l3lT) and (l32j) . we obtain 

3(x fe _i,? k ) < S(x fe _ 1 ,?fe_i). 

Thus, 

H(x fe ,<f fe ) + ^y^ll^fc - ^fc-i|| 2 < S(scjfe_i,?j fe _ 1 ). (33) 
Repeating the above process, we get 

fc-i 

Z(x k ,<; k ) + £ *^\\xi - x^f < B(x lj?1 ). (34) 

2=1 

On the other hand, 

Sp^^ajfc,^) = 3(x fc ,?fe) + ^Y~\\x k - x fc _i|| 2 
> s /t>*-i(a5fc,?) = 3(x fe! ^) + -yi||x fc - x fe _i|| 2 

>-(*,<;) + ^±||x fc -x fc _ 1 || 2 . (35) 
Substituting ([33|) into ([M]) gives rise to 

fc-2 

S(x,<0 + ^^11^-^-1 II* <S(n,ci), VfceN. 



Since {x k } is a bounded sequence, a k — > +oo and p k \. 0, the sequence x k is convergent, i.e., 
there exists a x such that x k ^ x. 
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2) The sequence {<ik} is convergent. We first show that is a bounded sequence. 
In a similar argument to the inequality (133[) . we can show that 

3(jCfc + i,Cfc +1 ) > E(x k +i,s) > S(ic,?). 

On the other hand, 

Sp^^fe+i^fe+i) = 5(a; fe+1 ,? fc+ i) + y ||:cfc + i - a;fc|| 2 
< S Pfc (S,^ fc+ i) = E(x,^ k+ i) + y||x - a; fc || 2 . 
Summing the above inequalities together yields that 

B(s, ?) - - x,|| 2 < S(x, ?) - f II* - 

< 3(Xfc+i,c) - y||x - £XJfe || 2 < 3(sB,? fc+1 ). 

By Assumption 2) and a; fc — ► a;, we know that <jfc is a bounded sequence. 

Now we suppose that there are two subsequences {sj.} and {s 2 .} of {<ik} such that {<i\} — > 
and {^j:} — J> c 2 . Denote {x\} and {a; 2 ,} are two subsequences of {xk} associated with {<^} and 
{<;%}. Clearly, s 1 ,^ 2 e S+. Note that 

,1 



a ( x k+l^) + y ll^fc+l ^fell 2 — "pjC^fc+D^ 2 



^ ^(^fe+D^l+i) — "(^fc+n Sfc+i) + ^ll^fe+i ~ ^fcll 2 - (36) 

Thus, 

Taking limit on both sides of the above inequality yields to 

E(x,^)<E(x,^). 

In a similar way, we can show that 
Therefore, 

H(x,0 = S(x,? a ) 
which implies that (j 1 = <; 2 . Hence, is a convergent sequence. 

3) We show that if {xk, Sk} — > (x, s), then (x, s) is a saddle point of Problem {ST). 
In a similar argument to 2), it is easy to show that for any t; E 5„ , we have 

S(x, «f) < S(x, 

So we only need to show that for any a?, 

S(x,§)<a(x,?). (37) 

Indeed, by the fact that 

E Ph (xk+i,<;k+i) < E Pk ( x ^k+i), Va. 
Passing limit to the above inequality yields to the inequality (|3"7]l. We complete the proof. ■ 
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In Theorem 21 there are three assumptions. Assumption 1) is on the selection of the parameters 
and Assumption 2) is always satisfied for strictly convex functions. Assumption 3) is important to 
ensure the convergence of Algorithm [TJ In fact, from our numerical experiments, we found that Xk 
might become unbound for certain cases. Therefore, a modified algorithm for solving Problem (V) is 
suggested as the following. 

Algorithm 2 

Step 1 Adopt Algorithm^ to solve Problem (SV). Denote the obtained solution as (x, s). 

Step 2 If \\A(x) — VV*(s)|| < e, output x is a global minimizer of Problem (V), where e is the 
tolerance. Otherwise, a gradient- based optimization method is used to refine Problem (V) with 
initial condition x. 

Remark 2 Since Problem (SV) is a convex- concave saddle point problem, many exact and inexact 
proximal point methods can be adapted [30, 31, 321. In fact, solving Problem (SV) is an easy task since 
it is essentially a convex optimization problem. However, to obtain a solution of Problem (V ) from the 
solution set of Problem (SV) is a difficult task since the identification of degenerate indices in the non- 
linear complementarity problem is hard \33\j . Unlike the classical proximal point methods, our proposed 
Algorithm{l\is based on a sequence of exterior point approximation. In this case, the gradient operator 
[VajS(cc,s), — V 5 3(aj, ?)] in R" x 5+ is not a monotone operator, but \y m E(x,s) + /XfcJ, — V 5 S(a;,?)] 
is monotone in R" x 5+. By the fact that C\ k S^ k — <S+, our algorithm generates a convergent se- 
quence and its clustering point is a saddle point of Problem (SV ) under certain conditions. Since 
[V x S(a;,<j), — V s S(a;,s)] in R™ x 5+ is not monotone for each sub-problem, it is natural to approxi- 
mate an optimal solution of Problem (V) under the perturbation of the regularized term ^pk\\x — Xk\\ 2 ■ 
This illustrates why our perturbed ( exterior penalty-type ) algorithm usually produces an optimal solu- 
tion of Problem (V), while the existing proximal point methods based on the interior point algorithm 
do not. 

Remark 3 In our proof of Theorem^ we require that pk — > 0. For classical proximal point methods, 
this condition was not required. In fact, this condition is adopted for simple proof that of clustering 
point (x,$) of the sequence {xk,<ik} being a saddle point of Problem (V). Our simulations show that 
Pk — > can be relaxed. Indeed, in our test simulations, we found that the convergence for the case of 
pk being chosen as a proper constant parameter is faster than that one of pk — >• 0. 

5 Numerical experiments 

This section presents some numerical results by proposed canonical primal-dual method. In our 
simulations, the involved SDP is solved by YALMIP [33] and SeDuMi [2"g] . 

Example 4.1. Let us first consider the optimization problem (|23|) . Taking pk = \ and fXk = OApk, 
the initial condition is randomly generated. Table Q] reports the results obtained by our method. 

From TableQ] we can see that all the four solutions (0, 1), (1, 0), (0, —1) and (—1, 0) can be detected 
by our algorithm with different (randomly generated) initial conditions. The corresponding G(?) ~ 0, 
as we shown in Proposition [2l can also be solved by perturbation method under any given tolerance. 
However, the following optimization problem 

^ m 

min P(x) = - Y j (x t A,x - d t f , (38) 
1=1 
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Table 1: Numerical results for optimization problem 



Initial condition 



x 



P(a) = i||^-A(a)|| J 



0.81472369 
0.90579194 
0.60684258 
0.48598247 
-0.61543234 
-0.79193703 
-0.92181297 
-0.73820724 



-1.12001364 x 10" 
1.00004756 
1.00004756 
5.39453096 x 10" 
0.56709252 x 10" 
-1.00004840 
-1.00004756 
0.12834042 x 10" 



-3.48372378 
-3.48372376 
-3.48358490 
-3.48358548 
-3.48379359 
-3.48379378 
-3.48370090 
-3.48370051 



x 10" 



0.93735607 x 10" 
0.93735508 x 10" 
0.93735627 x 10" 
0.93735602 x 10" 



Table 2: Numerical results for optimization problem (|38|) after 50 iterations 



(n, m) 



(20,25) 
(30, 35) 
(40, 50) 
(50,60) 



P(x) with pfc — 1/k 
and fi k = 0.1p fe 



4.67244827 X 10^~ 
2.10227829 X 10~ 5 
0.00154861 
0.00951209 



P(x) with p k = 0.1 
and fj, k = O.lpfc 



4.44146192 x 10" 
0.80404292 x 10" 
2.34887665 x 10" 
0.00032821 



cannot be solved by perturbation method in general, where Aj, i = 1, • • • , m, are randomly generated 
semi-definite matrix and di,i = 1, • • ■ , m, are chosen such that the optimal function value of P{x) is 0. 
In fact, G(s) = since the optimal cost function value of the optimization problem (|38|) is 0. Suppose 
that m is not too small (for example m > 20), for any given small perturbation A/, the corresponding 
saddle point problem (SV) has no solution (x,s) such that G(s) y by our numerical experiences. 
Thus, the linear perturbation method cannot be applied. Now we use our proposed algorithm to solve 
(|38p with different Pk and fi^- In about 80% cases, our method can capture a solution of Problem 
(V). The corresponding numerical results are reported in Table HJ 

During our numerical computation, we observe that for very few steps (for example, less than 
20 iterations), the numerical solution by our method is very close to one solution of Problem (V). 
In fact, for all the cases in Table [21 if we set e = 10~ 4 , then all the obtained results are satisfied 
with maxi \x* — x t i rue \ < e, i = 1, • • • , n, where x true = [irf'" e , ■ ■ • , x^ rne ] T is one of exact optimal 
solutions of Problem (V). However, it suffers from slow convergence. Table [5] shows it clearly for the 
last two cases. If a gradient-based optimization method is applied, then the optimal function value is 
P(x) w 10~ 8 for all cases in Tabled 

It is obvious that Problem (j35J) has at least two solutions because of its symmetry, i.e., if x is its 
solution, so is — x. Thus, classical SDP-based relaxation methods in [T^J [T31 [T3] cannot produce an 
exact solution. However, our method can produce one at the expense of iterative computation of a 
sequence of SDPs in most cases. 

6 Applications to Sensor Networks 

In this section, we apply our proposed method for sensor network localization problems. 

Consider N sensors and M anchors, both located in the <i-dimensional Euclidean space M. d , where 
d is 2 or 3. Let the locations of M anchor points be given as oi, a%, ■ ■ • , au € K d . The locations of N 
sensor points x\, x%, ■ ■ ■ , xn £ R d are to be determined. Let N x be a subset of ■ 1 < i < j < N} 
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in which the distance between the ith and the jth sensor point is given as and N a be a subset 
of {(i, k) : 1 < i < N, 1 < k < M} in which the distance between the ith sensor point and the fcth 
anchor point is given as e^. Then, a sensor network localization problem is to find vector Xi G M. d for 
alH = 1, 2, • • • , N, such that 



x l 
x, 



ak 



4, V(i,j)€N x , 
e 2 tk , V(t,k)eN a . 



(39) 
(40) 



When the given distances dy, (i, j) <E N x , and eik, (i, k) e N a , contain noise, the equalities (|39| and 
(I4U1) may become infeasible. Thus, instead of solving (|3"9")l and (|4U|) , we formulate it as a non-convex 
optimization as given below: 



mm 



E 



E 

(i,/c)£Af a 



k-« fe || 2 -4,) 2 



Denote a; = [xf, • • • , xJj] T £ M. dN . Then, (14"TT) can be rewritten as: 



(41) 



mm \ P(x) = £ (x T M 3 x - d%f + ]T (x T B rl x - 2/f fc!B - (<& - / f fe / lfc )) 2 }> . (42 ) 



where A y - = (E; - E^E, - Ej) T , B 44 = E;Ef , 

/ dxd \ 



E, 



V Odxd J 



and / ifc 



/ d \ 
V d J 



As in [T31 , the root mean square distance 



RMSD 



N E 



H 112 



i=l 



is adopted to measure the accuracy of the locations of the sensor i, i = 1, • ■ • ,N, where Xi and x* are 
the estimated position and true positions, respectively, i = 1, ■ ■ ■ , N . The software package SFSDP 
[36j is applied for generating test problems and comparison. During our simulation, all of sensors are 
placed in [0, l]x[0, 1] randomly and 4 anchors are fixed at (0.125,0.125), (0.125,0.875), (0.875,0.125), 
and (0.875,0.875), respectively. 

For the conventional SDP relaxation methods, the computed sensor locations match its true lo- 
cations if and only if the corresponding sensor network is uniquely localizable |T2l [13]. Thus, if the 
localized sensor network has multiple solutions, the conventional SDP relaxation methods [13l [36] fail 
to produce a good solution of the optimization problem defined by ([42]) . Let us consider the following 
network with multiple solutions: 



Example 5.1 Consider a sensor network containing 6 sensors and 4 anchors depicted in Fig- 
ure [TJ From Figure [H we can see that the sensors x%, x^ and xi, have two positions. More 
specifically, x-i can be either (0.0791,0.0091) or (0.0091,0.1709), x 3 , x 5 can be either the pair of 
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0.9 
0.8 
0.7 
0.6 
0.5 
0.4 
0.3 
0.2 
0.1 


0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 

Figure 1: Network topology of 6 sensors and 4 anchors 



Table 3: Numerical results for 6 sensors and 4 anchors 





True solutions 




Solutions by SDP in 14 




Solutions by Algorithm \T\ 




(0.5818,0.0968) 




(0.5818,0.0961) 




(0.5818,0.0967) 


Xj 2 


(0.0791,0.0091) 


£2 


(0.0775,0.0100) 


X2 


(0.0056,0.1599) 




(0.0091,0.1709) 










x 3 


(0.7342,0.8470) 


£3 


(0.7334,0.8985) 


&3 


(1.0167,0.8980) 




(1.0158,0.9030) 










x\ 


(0.1936,0.6169) 


£4 


(0.1946,0.6170) 


£4 


(0.1937,0.6169) 


x % 


(0.8506,0.7257) 


£5 


(0.7995,0.7439) 


x 5 


(0.9047, 1.0234) 




(0.8994, 1.0243) 










X G 


(0.4301,0.2720) 


£ 6 


(0.4300,0.2713) 


x e 


(0.4299, 0.2718) 



[(0.7342, 0.8470), (0.8506, 0.7257)] or the pair of [(1.0158, 0.9030), (0.8994, 1.0243)]. Let x* , x and x be 
the true sensor locations, sensor locations computed by the SDP method (|14j). and sensor locations 
computed by Algorithm^ respectively. The results are depicted in Figure 2 (a) and Figure 2 (c). The 
true sensor locations (denoted by circles) and the computed locations (denoted by stars) are connected 
by solid lines. From the two figures, we can clearly see that our method produce better estimations 
than the SDP relaxation method in [T3]. However, we need to solve a sequence of SDPs, but in |14j . 
only one SDP is involved. To achieve a higher accuracy, we apply the gradient-based optimization 
method in SFSDP to refine the solutions obtained by our method and that obtained by SDP method 
in [14]. After refinement, RMSD obtained by SFSDP is 4.91 x 10 -5 and 2.07 x 10~ 8 is obtained by 
our method. The refined results are depicted in Figure 2 (b) and (d). From Figure 2 (b), we observe 
that there are still big errors for the sensor 3 and sensor 5 obtained by the refinement of SDP method 
in [14] • Figure 2 (d) shows that our method produces one of the exact solutions of the optimization 
problem defined by (|42[) . Thus, our method achieves better performance no matter before or after 
refinement. 

In practical circumstances, the exact distances dij and eik are unavailable because of the presence 
of noise during the measurement. To model such a case, we perturb the distances as: 

dkj = max{(l + 0.1}dy e JV X ), (43) 

e lk = max{(l + & fc ),0.1}e tt ((t,fe) e N a ), (44) 

where £y , are random variables and chosen from the standard normal distribution N(0, a), where 
a is the noisy parameter. By substituting (|43]) and (|44]) into (|42]) . the corresponding optimization 
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V 



0.1 0.2 0.3 0.4 0.5 0.5 0.7 



(a) Results by SFSDP 






I o ■ 






• 




- 


* 1 1 1 





0.9 1 



0.1 0.2 0.3 0.4 0.5 0.6 07 
(b) Results by SFSDP plus the refinement 



02 0.4 0.6 0.8 

(c) Results by Algorithm [T] 



0.4- 



02 0.4 0.6 0.8 

(d) Results by Algorithm [5] 



Figure 2: Computed locations information of 6 sensors and 4 anchors 
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problem involved in noisy distance is obtained. 

Example 5.2 Consider a sensor network localization problem with 20 sensors, 4 anchors. Let 
the radio range be 0.3 and the noisy parameter be 0.001, respectively. A sensor network generated 
randomly by these parameters is depicted in Figure 3. From Figure 3, we can verify that for this 

0' 9 r 




0.2 0.4 0.6 0.8 1 

Figure 3: Network topology of 20 sensors and 4 anchors 

sensor network, it has a unique solution. 

We apply Algorithm[2]and the SDP method in |14j in conjunction with a gradient-based refinement 
method to solve it. The computed results are listed in Table [4] The RMSD computed by SFSDP 
in conjunction with a gradient-based refinement method is 9.95xl0 -2 while that computed by our 
method is 4.1041 x 10~ 7 . The computed results by Algorithm [2] and by SDP in conjunction with a 
gradient-based refinement method in [T3] are depicted in Figure SJ From Figure 4 and the values of 




0,1 0.2 0.3 0.4 0.5 0.6 07 0.8 O.S 1 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 O.S 1 

(a) Results by SFSDP plus the refinement (b) Results by Algorithm [5] 

Figure 4: Computed locations information of 20 sensors and 4 anchors 
RMSD, we know that our method achieves better performance than that by SFSDP in conjunction 
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Table 4: Numerical results for 20 sensors and 4 anchors 





True solutions 




Solutions by SDP -f- refinement in 1 141 




Solutions by Algorithm [2] 


x 1 


(0.5818, 0.0968) 


- 


(0.6203. 0.2107) 


- 


(0.5815, 0.0963) 


2 


(0.0791, 0.0091) 




(0.1379, 0.0015) 


- 


(0.0795, 0.0091) 


x 3 


(0.7342, 0.8470) 




(0.7369. 0.8030) 


X , 3 


(0.7343, 0.8475) 


\t 


(0.1936, 0.6169) 


X 


(0.2384, 0.6406) 


Xi 


(0.1939, 0.6168) 


x 5 


(0.8506, 0.7257) 




(0.8610, 0.7040) 




(0.8503, 0.7258) 


Xq 


(0.4301, 0.2720) 


X 


(0.4319, 0.2943) 




(0.4301, 0.2719) 


x 7 


(0.9846, 0.5671) 


- 


(0.7621, 0.5022) 




(0.9833, 0.5670) 


Xg 


(0.3429, 0.3741) 


- 


(0.3399, 0.3793) 


- 


(0.3430, 0.3739) 


Xg 


(0 9070 66631 


xl 


fO 261 2 6874 s ! 




(0 2067 6662 s ! 




(0.6176, 0.5756) 


XlQ 


(0.6612, 0.5025) 


X 10 


(0.6172, 0.5762) 


x 1± 


(0.1644,0.2955) 


Xll 


(0.1643,0.3085) 


in 


(0.1643, 0.2956) 


x 12 


(0.6533,0.2237) 


X12 


(0.6984,0.3363) 


X12 


(0.6530, 0.2229) 


x 13 


(0.6673,0.8736) 


X13 


(0.6683,0.8336) 


X13 


(0.6676, 0.8746) 


X 14 


(0.2161, 0.6226) 


Xli 


(0.2607,0.6429) 


in 


(0.2165, 0.6226) 


X U 


(0.7701,0.3595) 


£15 


(0.6232, 0.2186) 


^15 


(0.7691, 0.3595) 


X 1G 


(0.1894,0.1458) 


X16 


(0.1637,0.1663) 


iis 


(0.1893, 0.1460) 


x 17 


(0.8786,0.8741) 


XlT 


(0.8746,0.8626) 


in 


(0.8789, 0.8743) 


x 18 


(0.4776,0.6487) 


X18 


(0.5169,0.5805) 


iis 


(0.4777, 0.6502) 


x 19 


(0.2370,0.5215) 


Xig 


(0.2477,0.5368) 


iw 


(0.2378, 0.5215) 


X 2Q 


(0.2197,0.0249) 


X20 


(0.0236,0.0836) 


X20 


(0.2202, 0.0253) 



with a gradient-based refinement method. This is because if the distances are inexact, the SDP-based 
methods in [T3J H3] are not ensured to produce a good solution. However, our method is based on the 
global solution of the optimization problem defined by (|42[) . Thus, the inexact measurements do not 
deteriorate the performance of our method. 

Example 2.3 Consider a sensor network localization problem with 50 sensors, 4 anchors and noisy 
perturbation being 0.001. The corresponding connections between sensors and sensors and sensors 
and anchors are depicted in Figure [5] 




0.2 0.4 0.6 0.8 1 



Figure 5: Network topology of 50 sensors and 4 anchors 

The computed results by Algorithm [2] and by SFSDP in conjunction with a gradient-based re- 
finement method is depicted in Figure [51 The RMSD computed by SFSDP in conjunction with a 
gradient-based refinement method is 1.07 x 10 , while that by our method is 1.9956 x 10~ 5 . Both 
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Figure Inland the values of RMSD show that our method achieves better performance. 
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(a) Results by SFSDP plus the refinement 



(b) Results by Algorithm 



Figure 6: Computed locations information of 50 sensors and 4 anchors 



7 Conclusion 

This paper presented an effective method and algorithms for solving a class of non-convex optimization 
problems. By using the canonical duality theory, the original non-convex optimization problem is first 
relaxed to a convex-concave saddle point optimization problem. Depending on the singularity of the 
matrix G, this relaxed saddle point problem is classified in two cases: degenerate or non-degenerate. 
For the non-degenerate case, the solution of the primal problem can be recovered exactly through 
solving a convex SDP problem. Otherwise, a quadratic perturbed primal-dual scheme is proposed to 
solve the corresponding degenerate saddle point problem. We proved that, under certain conditions, 
the sequence generated by our proposed scheme converges to a solution of the corresponding saddle 
point problem. If this saddle point satisfies the condition of ||A(x) — VV*(?)|| < e within a given error 
tolerance, then the solution of the primal problem is also recovered exactly. Otherwise, x is taken as 
a starting point and a gradient-based optimization method is applied to refine the primal solution. 
Numerical simulations show that our method can achieve better performance than the conventional 
SDP-based relaxation methods. 



References 

[1] J.M. Ball: Some open problems in elasticity. In Geometry, Mechanics, and Dynamics, pages 3-59, 
Springer, New York, 2002. 

[2] E. G. Birgin, C. A. Floudas and J.M. Martinez, Global minimization using an Augmented La- 
grangian method with variable lower-level constraints, Math. Program., Ser. A (2010) 125:139- 
162. 

[3] J. Gallier, The Schur complement and symmetric positive semidefinite (and definite) matrices, 
www.cis.upenn.edu/~jean/schurcomp.pdf. 



19 



[4] Gao, D.Y.: Duality Principles in Nonconvex Systems: Theory, Methods and Applications. Kluwer 
Academic, Dordrecht (2000). 

[5] Gao, D.Y. (2007). Solutions and optimality to box constrained nonconvex minimization problems 
J. Indust. and Manage. Optim., 3(2), 293-304. 

[6] Gao, D.Y.: Canonical duality theory: unified understanding and generalized solutions for global 
optimization. Comput. Chem. 33, 1964-1972, (2009). 

[7] Gao, D.Y. and Ruan, N. (2010). Solutions to quadratic minimization problems with box and 
integer constraints, J. Global Optimization, 47:463484. DOI 10.1007/sl0898-009-9469-0 

[8] Gao, D.Y., Ruan, N, and Pardalos, P.M. (2010). Canonical dual solutions to sum of fourth-order 
polynomials minimization problems with applications to sensor network localization, in Sensors: 
Theory, Algorithms and Applications, P.M. Pardalos, YY. Ye, V. Boginski, and C. Commander 
(eds). Springer. 

[9] Gao, D.Y., Strang, G.: Geometric nonlinearity: Potential energy, complementary energy, and the 
gap function. Quart. Appl. Math. 47(3), 487-504 (1989). 

[10] A. Kaplan and R. Tichatschke, Proximal point methods and nonconvex optimization, J. Glob. 
Optim., 13, 389-406, 1998. 

[11] T.K. Pong, and P. Tseng, (Robust) Edge-based semidefinite programming relaxation of sensor 
network localization, Math. Program. 130(2) (2011) 321-358. 

[12] Z. Wang, S. Zheng, Y. Ye, and S. Boyd, Further relaxations of the semidefinite programming 
approach to sensor network localization, SIAM J. Optim., 19 (2008), pp. 655-673. 

[13] A. M. So and Y. Ye, Theory of semidefinite programming for sensor network localization, Math. 
Program. Scr. B, 109 pp. 367-384 (2007). 

[14] S. Kim, M. Kojima and H. Waki, Exploiting sparsity in SDP relaxation for sensor network 
localization. SIAM J. Optim. 1, pp. 192-215 (2009). 

[15] J. More and Zhijun Wu, Distance geometry optimization for protein structures, J. Glob. Optim., 
15, 219-234, 1999. 

[16] J. J. More, Generalizations of the trust region problem, Tech. Report MCS-P349-0193, Argonne 
National Labs, Argonne, IL, 1993. 

[17] C. Li and X. Wang, On convergence of the Gauss-Newton method for convex composite opti- 
mization, Math. Program., 91, 349-356 (2002). 

[18] A.S. Lewis and S. J. Wright, A proximal method for composite minimization, arXiv:0812.0423vl. 

[19] J.B. Lasserre, Global optimization with polynomials and the problems of moments. SIAM J. 
Optim. 11, (2001) 796-817. 

[20] J.E. Marsden and T.J.R. Hughes: Mathematical Foundations of Elasticity. Prentice-Hall, 1983. 

[21] Ruan, N. and Gao, D.Y.: Canonical duality approach for nonlinear dynamical systems, IMA J. 
Appl. Math., to appear. 



20 



[22] Ruan, N., Gao, D.Y., and Jiao, Y.: Canonical dual least square method for solving general 
nonlinear systems of quadratic equations, Computational Optimization and Applications, Vol 47, 
335-347 (2010). 

[23] Y. Nesterov, Dual extrapolation and its applications to solving variational inequalities and related 
problems, Math. Program., Scr. B (2007) 109, 319-344. 

[24] Y. Nesterov, Primal-dual subgradient methods for convex problems, Math. Program., Ser. B 
(2009) 120, 221-259. 

[25] G.M. Korpelevich, The extragradient method for finding saddle points and other problems, 
Ekonomika i Matematicheskie, 12, (1976) 747-756. 

[26] B. Taskar, S.L. Julien and M.I. Jordan, Structured prediction, dual extragradient and bregman 
projections, J. Mach. Learn. Res., 7 (2006) 1627-1653. 

[27] B.S. He and L.Z. Liao, Improvement of some projection methods for monotone nonlinear varia- 
tional inequalities, J. Optim. Theory Appl., (2002) 112, 111-128. 

[28] J. F. Sturm, Using ScDuMi 1.02, a MATLAB toolbox for optimization over symmetric cones, 
Optim. Methods Softw., vol. 12, pp. 625-633, 1999. 

[29] J. Loberg, YALMIP : A toolbox for modeling and optimization in Matlab, Proc. Int. Symp. 
CACSD, Taipei, Taiwan, Sep. 2004, pp. 284-89. 

[30] R.T. Rockafellar, Monotone operators and the proximal point algorithms, SIAM J. Cont. Optim., 
14, 887-898, 1976. 

[31] B.S. He and X.M. Yuan, An accelerated inexact proximal point algorithm for convex minimiza- 
tion, J. Optim. Theory Appl., (2012) 154, 536-548. 

[32] O., Guler, New proximal point algorithms for convex minimization. SIAM J. Optim. (1992) 2, 
649C664. 

[33] N. Yamashita, H. Dan and M. Fukushima, On the identification of degenerate indices in the 
nonlinear complementarity problem with the proximal point algorithm, Math. Program., (2004), 
99, 377-397. 

[34] Gao, D.Y. and Wu, C.Z.: On the triality theory for a quartic polynomial optimization problem, 
J. Ind. Manag. Optim. 8(1), 229-242, (2012). 

[35] R.A. Horn, C.R. Johnson, Matrix Analysis, Cambridge University Press, 1985. 

[36] S. Kim, M. Kojima, H. Waki, and M. Yamashita, User Manual for SFSDP: a Sparse versions of 
Full SemiDcfinite Programming Relaxation for Sensor Network Localization Problems. Research 
Reports on Mathematical and Computer Science, SERIES B, (2009). 

[37] Zhang J., Gao, D.Y. and Yearwood, J.: A novel canonical dual computational approach for prion 
AGAAAAGA amyloid fibril molecular modeling. Journal of Theoretical Biology, 284, 149-157 
(2011). doi:10.1016/j.jtbi.2011.06.024 



21 



